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Synchronization on Lie Groups: Coordination of 

Blind Agents 

Farzin Taringoo 


Abstract —This paper presents an algorithm for the synchro¬ 
nization of blind agents (agents are unahle to observe other 
agents, l.e. no communication) evolving on a connected Lie group 
G. We employ the method of extremum seeking control for 
nonlinear dynamical systems defined on connected Riemannian 
manifolds to achieve the synchronization among the agents. This 
approach is independent of the underlying graph of the system 
and each agent updates its position on G by only receiving 
the synchronization cost function. The results are obtained by 
employing the notion of geodesic dithers for extremum seeking 
on Riemannian manifolds and their equivalent version on Lie 
groups and applying Taylor expansion of smooth functions 
on Riemannian manifolds. We apply the obtained results to 
synchronization problems defined on Lie groups 50(3) and 
SE{3) to demonstrate the efficacy of the proposed algorithm. 

Index Terms —Synchronization, Riemannian Manifolds, Quo¬ 
tient Manifolds. 

I. Introduction 

Synchronization is an important topic in analysis of multi¬ 
agent systems, see 0-IID- This problem may arise as the 
behavior of agents in nature. The synchronization problem 
has been extensively analyzed from control and optimization 
point of view, see 0. Various aspects such as opti¬ 
mality of configurations, collision avoidance and mean field 
stochastic games have been studied for this class of problems. 
Synchronization of agents is closely related to the consensus 
problem in which agents minimize the summation of their 
local objective functions, see 0 - Depending on cost 

functions defined for the network of agents, a synchronization 
problem can be converted to a consensus problem, see ©■ 

Many optimization methods have been extended to address 
synchronization and consensus problems, see 0 - A key 
factor in the optimization methods developed for such prob¬ 
lems is that each agent optimizes the cost function using its 
local variables or information, i.e. the optimization problem 
is in the category of decentralized optimization problems. 
Since synchronization cost functions depend on all agents state 
trajectories, a successful implementation of local optimiza¬ 
tion algorithms necessitates information exchange among the 
agents in the network, see 0, @, ®, 0, (TT), ig. In this 
case convergence of optimization algorithms highly depend on 
the topology of the network. 

In this paper we employ a class of optimization methods 
(extremum seeking algorithms) which makes agents local 
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optimizations independent of the state of other agents in the 
network. That is to say, each agent updates its current state 
only with respect to the monitored synchronization cost. In this 
setting, we accept the fact that all agents have full information 
about the total objective function defined for their synchro¬ 
nization. This problem falls within the class of cooperative 
team problems in which agents aim to optimize the aggregated 
cost function. Using the approach of this paper, agents local 
optimization is independent of the network topology which is 
one of the main contributions of this paper. 

We also consider a network of agents evolving on a con¬ 
nected Lie group. In this case, the convergence analysis of 
the proposed algorithm is obtained for a generic Riemannian 
metric which distinguishes our approach from the methods 
presented in 0, 0, ng, where only the embedded Eu¬ 
clidean metrics were considered. The analysis presented in 
0 and |Tg is restricted to the ambient Euclidean spaces of 
Riemannian submanifolds. However, in general, embeddings 
of Riemannian manifolds may not be available (their existence 
is guaranteed by Nash Theorem) and the resulted Euclidean 
spaces may be very high dimensional. This makes the imple¬ 
mentation of optimization algorithms problematic and opti¬ 
mization algorithms on the main Riemannian manifolds might 
be more efficient in terms of computation burden, see GD- 

In terms of exposition. Section II presents some mathe¬ 
matical preliminaries needed for the analysis of the paper 
and formulates the synchronization problem on Riemannian 
manifolds. Section III presents the extremum seeking problem 
for nonlinear dynamical systems on Riemannian manifolds 
and gives the analysis of extremum seeking systems for 
synchronization of agents on Riemannian manifolds. 

II. Preliminaries and problem formulation 

Definition 1 ( ]15) ). A Riemannian manifold {M, gM) is a 
differentiable manifold M together with a Riemannian metric 
gM, where gM '■ TxM x T^M —> E, is symmetric and positive 
definite and T^M is the tangent space at x e M (see & 
Chapter 3). For M = E”, the Riemannian metric g^n is given 
by 

where Sij is the Kronecker delta. ■ 

Definition 2 (||T6)). For a given smooth mapping F : M ^ N 
from manifold M to manifold N, the pushforward (differential) 
operator TF is defined as a generalization of the Jacobian of 
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smooth maps in Euclidean spaces as follows: 

TF : TM TN, (1) 

where 

T,F : T,M -> ( 2 ) 

and 

T,F{X,) o f = X,{f o F), X, e T,M, / e C^{N). 


In this paper we present the final results for connected finite 
dimensional Lie groups which are manifolds equipped with 
smooth group operations. However, some parts of the analysis 
are presented for general Riemannian manifolds. On an n 
dimensional Riemannian manifold M, the length function of 
a smooth curve 7 : [a, 6 ] ^ M is defined as 

rb 


^( 7 ) = [ 

Ja 


where g denotes the Riemannian metric on M. The following 
theorem ensures that for any connected Riemannian manifold 
M, any pair of points x,y e M can be connected by a 
piecewise smooth path 7 . 


Theorem 1 (fls), Page 94). Suppose (M, ^m) is an n 
dimensional connected Riemannian manifold. Then, for any 
pair x,y e M, there exists a piecewise smooth path which 
connects x to y. ■ 


Consequently we can define a metric (distance) d on an n 
dimensional Riemannian manifold (M, pm) as follows: 


d : M X M ^ R, 


1 

d{x,y)= inf dt, (3) 


where 7 : [a, 6 ] M is a piecewise smooth path and 7 ( 0 ) = 
= y. 

Employing the distance function above it can be shown 
that (M, d) is a metric space. This is formalized by the next 
theorem. 


Theorem 2 (fTs), Page 94). With the distance function d 
defined in 0 . any connected Riemannian manifold is a metric 
space where the induced topology is the same as the manifold 
topology. ■ 

The Levi-Civita connection V : X{M) x X{M) X{M) 
is the unique linear connection on M (see Theorem 5.4) 
which is torsion free and compatible with the Riemannian 
metric gM as follows {X{M) is the space of smooth vector 
fields on M): 

compatibility with gM 

XgM{Y,Z) = gM{yxY,Z) + gM{Y,VxZ), (4) 

(i) (torsion free) : XxY — VyX = [X, Y], 

(ii) : Xxf = Xif), (5) 

where X,Y,Z e X{M). 


A. Dynamical systems on Riemannian manifolds 

This paper focuses on dynamical systems governed by 
differential equations. Locally these differential equations are 
expressed by (see m 

x{t) = f{x{t),t), 

f{x{t),t) e a;(0) =xoe M,tB [to,tf]. 


The time dependent flow associated with a differentiable time 
dependent vector field f is a map $f satisfying : 

X [to,tf] X M M, 

{to,s,x) ^ ^f{s,to,x) e M, 


and 


d$/(5,fo,x) 

ds 


f{^f{t,to,x),t). 


One may show, for a smooth vector field /, the integral flow 
$/(s,fo)-) : M ^ M is a local diffeomorphism , see p^ . 
Here we assume that the vector field / is smooth and complete, 
i.e. 4)/ exists for all t G {to,co). 


B. Geodesic Curves 

As known (see GZ))’ geodesics are defined as length mini¬ 
mizing curves on Riemannian manifolds which satisfy 

V7(t)7W = 0, 

where 7 (-) is a geodesic curve on (M, pm)- 

Definition 3 (fTS]). The restricted exponential map is defined 
by 


exp^ : TxM -> M, exp^(w) = 7 «(l),u G T^M, 

where 7 i,(l) is the geodesic initiating from x with the velocity 
V up to t = 1. ■ 

For brevity, in this paper we refer the restricted exponential 
maps as exponential maps. For x G M, consider a S ball in 
TxM such that 5^(0) = {u G TxM\ ||u||g = gM{v,v)^ < 
(5}. Then the geodesic ball is defined as follows. 

Definition 4 ( ]15) ). In a neighborhood of x e M where exp^ 
is a local diffeomorphism (this neighborhood always exists by 
Lemma [7] below), a geodesic ball of radius S > 0 is denoted 
by exp^(i? 5 ( 0 )) c M. Also we call exp^(i 35 ( 0 )) a closed 
geodesic ball of radius 5. ■ 

Lemma 1 (fTS]). For any x e M there exists a neighborhood 
Bs(0) in T^M on which exp^ is a diffeomorphism onto 
expffBsiO)) c M. ■ 

Definition 5 (p3)). A normal neighborhood around x e M is 
any open neighborhood of x which is a diffeomorphic image 
of a star shaped neighborhood of 0 e T^M under exp^ map. 


Definition 6. The injectivity radius of M is 
i{M) = inf *(x), 

xeM 
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where 

i{x) = sup{r G lElgtol exp^ is dijfennorphic onfoexp^ 5^(0)}. 

( 6 ) 


The following lemma displays a relationship between nor¬ 
mal neighborhoods and metric balls defined before on M. 

Lemma 2 (p^). If exp^(-), x e M, is a local diffeo- 
morphism on i?e(0) cz T^M, e G ]R,>o, and B{x,r) a 
exp^S£(0), then 

exp^BriO) = B{x,r), 

where B{x,r) is the metric ball with re¬ 
spect to the Riemannian distance function. 

■ 

We note that -Be(O) is the metric ball of radius e with respect 
to the Riemannian metric pM in T^M. 

The following lemma bounds the injectivity radius of com¬ 
pact Riemannian manifolds, see Definition 

Lemma 3 (p^). The injectivity radius i{x),x G M is 
continuous with respect to x and is bounded from below for 
compact Riemannian manifolds. ■ 

By the results of Corollary 5.3, and Lemma in the 
case i{M) > 0, for any r ^ i{M), such that B{x,r) a 
exp^ Bi(M)(0), we have 

B{x,r) = exp^ Br{0). 

III. Synchronization on Riemannian manifolds 
AND Lie groups 

Let us consider a set of m agents A = {I,-’’ )”!■}> on 
a connected n dimensional Riemannian manifold (M, pm) 
where the state of each agent lies on M, i.e. Xi G M, i = 
1, • • • m. The synchronization for A is met when xi = X 2 = 

■ ■ ■ Xm e M, see Q. For the network of agents A, an 
undirected graph Q{y,S) has a finite set of vertices V and a set 
of unordered edges S. A link which connects vertices i and j 
is denoted by (i, j) G £. Corresponding to cci, i = 1, • • • , m, 
a cost function to penalize the deviation from the synchronized 
configuration is proposed in |[^ as 

J{xi,-■ ■ ,Xm) = ]. 2 d^{Xi,Xj), ( 7 ) 

where d is the Riemannian metric on {M,gM)- As is obvious 
the unique global minimum of J is given by xi = X 2 = 

■ ■ ■ Xm, i e- at the synchronization state. The optimization 

problem defined in is a special case of the optimization 
of a cost function J : M x M ■ ■ ■ x M ^ defined on 
the Riemannian manifold M x M ■ ■ ■ x M. In the case that 
the graph Q is fully connected the cost function 0 changes to 
J{xi,--- ,Xm) = Is™ As an example 

in the case M = SO{n) and d as the Frobenius metric, we 


have 13) 

J{xi,---,Xm) = A Xj ^^{(Xi - Xj)^(Xi - Xj)) 

Zl (8) 

where Xi G SO{n). One of the most popular optimization 
algorithms for minimization(maximization) of J is the gradi¬ 
ent descent method. The decentralized version of the gradient 
method for each agent is given by 

= -gradxA, 

where dJi{X) = gl^grad^i, X) ^ ^ T^M. Note that 

dJi : Ta;M ^ R, is the differential form of J with respect to 
the state of agent i. For the cost function J = S(i ~ 

tr{xfxj)) on S'O(n)'", we have 

Xi = ^Xi ^ {xjxj - x'^Xi), i = (9) 

r\i,3)^£ 

Obviously, in order to implement (j^, agent i has to know 
the state Xj of all the agents j, where {i,j) G £. That 
necessitates communication or information exchange among 
agents in decentralized algorithms, see 0 . 

In this paper we present the final results on a connected Lie 
group G (for the definition of Lie groups see pO)). Let us 
denote a Lie group (G, *) as the state configuration manifold 
for all agents. Note that * is the group operation of G. We 
recall that the Lie algebra £ of a Lie group G (see 0 , @) is 
the tangent space at the identity element e with the associated 
Lie bracket defined on the tangent space of G, i.e. C = T^G. 
A vector field X on G is left invariant if 

^9i,g2^G, X{gi * g 2 ) = Tg^giX{g 2 ), 

where g* : G G, g*{h) = g*h, , Tg^g : Tg^G ^ Tg^g^G- 
That immediately implies X{g*e) = X{g) = T^LgX{e). For 
a left invariant vector field X, we define the exponential map 
as 

exp : £ ^ G, exp(fX(e)) := <i>(f, X), f G R, (10) 

where <I>(£X) is the integral flow of g{t) = X(g(f)) with 
the boundary condition g{0) = e. Note that exp(fX(e)) is 
not necessarily the same as the geodesic exp map defined in 
Definition |3] 

The synchronization cost defined in 0 has a critical set of 
points denoted by Gc, which minimizes 0 , where p G Gc 
implies that J{gc) = 0. Motivated by the cost function 0, 
the synchronization critical set is given by 

Gc = {{g, ■ ■ ■ ,g) \ g ^ G}. (11) 

It is imediate that Gc c G x ■ ■ ■ x G. The set ( [TT] i characterizes 
all the possibilities of synchronization for the agents in the 
network. The following lemma shows that Gc is a Lie group 
in the topology induced by G™ = G x • • • x G. We denote 
the Lie algebra corresponding to G™ by £™. 

Lemma 4. The critical set (1Z3 is a Lie subgroup of the Lie 
group G™. 
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Proof: First we note that G™ is a Lie group. This is 
immediate by the group structure of G. In order to prove Gc 
is a Lie subgroup we have to show that Gc is a closed subgroup 
of G™. Obviously Gc is not empty. For any gi,g2 e Gc we 
have gi*gf^ e Gc, where * is the group operation inherited 
from G on G™. This proves that Gc is a subgroup of G™. 
In order to show Gc is a Lie group it remains to prove the 
closeness of Gc in the topology of G™. This is also immediate 
since based on the structure of Gc, any converging sequence 
gn ^ g*, gn ^ Gc implies that g* e Gc, which yields the 
closeness of Gc in the topology of G™. By applying Cartan’s 
Lemma | | 20 ) , Gc is a Lie subgroup and consequently a Lie 
group. ■ 

The following lemma gives a Riemannian structure on the 
Lie group G™ based on inner products in G™. 

Lemma 5 (f^). An inner product I: G™ x G"* —> R, induces 
a left invariant Riemannian metric on G™ as 

gG--{Vg,Wg) = l{Tgg-'^{Vg),Tgg-'^{Wg)), 

Vg, Wg e TgG'^ ^ 

where Tgg~^{vg) e G”^. Furthermore, any left invariant 
Riemannian metric gQm is identified via left translation by 
its value ggm(^e"^), where e"* is the identity element of G"^. 

■ 

Note that Tg~^ is the pushforward of the smooth map 
5-1* : G™ ^ G™. 

In order to analyze the extremum seeking algorithm in the 
next section for the synchronization cost (|^, we need to use 
the notion of Quotient Manifolds as follows. As shown by 
Lemma the critical set Gc is a Lie subgroup of G"*. This 
implies the existence of a left (right) group action from Gc to 
G"* by 

Gc X G”" ^ G”^, 

where 51*52 6 G"* for 51 e Gc and 52 e G™. By employing 
the left action above, we introduce an equivalent class induced 
by Gc on G™ as 51 ~ 52,51,52 s G™, if there exists 
5 e Gc, such that 5*51 = 52. This induces a projection 
TT : G™ —> G™/Gc by 71(5) = [5], where [•] is the equivalent 
class operator and G^/Gc is the quotient space. In this paper 
we denote [5] c G"* and 77(5) e G™/Gc. Note that in 
general, quotient spaces are not manifolds and may not be 
even Housdorff spaces, see HD- Since by Lemma | 4 | Gc is a 
Lie group, the following result shows that the quotient space 
G"^ jGc is a smooth manifold. 

Lemma 6 (Theorem 21.17 in fTh) , edition 2012 ). The quotient 
space G™' jGc has a smooth manifold structure and tt : G"* -* 
G'^jGc is a smooth submersion. 

Definition 7 . A smooth function J : G"* —> R is invariant 
with respect to Gc if 

J{ 9 c*g) = J{g), gc^GcgsG'^. 

■ 

As an example consider (G™,*) = (R*”, +). Hence, Gc = 
Ur€R(^’ • • • ,r) c R™. The Euclidean distance function || • 


is invariant with respect to Gc since 

Iki - r 2 ||R™ = ||ri + r - r 2 - r||^„. 

Another example is the cost function (|^ which is invariant 
with respect to its corresponding Gc since tr{xf Q^Qxj) = 
tr{xfxj) for Q e SO{n). 

Definition 8. On the Lie group G"*, a vector field X e X(G"*) 
is invariant with respect to Gc, if 

^{9c*9) = Tggc{X{g)), gceGc,9sG™, 

where Tgc is the pushforward of the smooth group operation 

gc* : G^ G™. ■ 

We note that vector fields on the base manifold G™ do not 
necessarily induce vector fields on G^/Gc. This is due to the 
fact that if X{gi) A X{g2), 51,52 e [5]^ where 2 f e X(G"*), 
thenTg^ 7 r( 2 f( 5 i)) e T„(g^) G"^jGc is not necessarily identical 
to Tg^ 7 r{X{g 2 )) s T.^i^g.^^^G'^jGc- However, in the case that X 
is invariant with respect to Gc, Tt:{X) induces a vector field 
on G'^IGc- This follows as 


TT O 5c*5 = TT O 5 , gcG Gc,g e G"^. ( 12 ) 

Hence, the smoothness of tt (Lemma |^, implies 

oTggc{X{g)) = Tg^^gir o X{gc*g) 

= TgiroXig), 

where the first equality is by Definition and the second 
equality is given by ( 12 1. This implies that both X{gc*g) and 


X{g) induce the same tangent vector at 77(5) e G™/Gc. 

Parallel to the construction of vector fields on G^/Gc, we 
can assign a Riemannian metric to G'^/Gc. It is important to 
note that the structure of the Riemannian metric of the base 
manifold G™ stipulates the structure of the Riemannian metric 
in G'^/Gc. Following the results of chapter 3 , for any 
tangent vector Vg e TgG'^/Gc and for any 5 e 7r“^(5), there 
exist tangent vectors Vg G TgG'^ such that 


TgiriVg) = Vg G TgG^/Gc- 


( 13 ) 


In order to define a Riemannian metric on G™’jGc, we 
need to employ the Riemannian metric of G"* and ap¬ 
ply that to horizontal lifts (see ED) of tangent vectors 
at TG'^/Gc- However, for 51,52 e 7r“^(5), Vg^,Wg^ G 
Tgj^G"^,Vg^,Wg 2 G Tg^G'^ , L is not guaranteed that 
5G™(t)gi,w§i) = 5 g-(% 2>S2)’ whereas Tg^7r(r)gJ = 

Tg.^TT{vgf) and Tgj7r(?i)gJ = rg2 7r(wg2)-The following lemma 
shows that in the case that the Riemannian metric of the base 
manifold G”^ comes from an inner product on its Lie algebra 
then we can define an unambiguous Riemmanina metric on 
G'^/Gc with respect to ga^- 

Lemma 7 . Consider the Lie group G"* with a Riemannian 
metric corresponding to an inner product I : x C™ —> R. 

Then, for all 51,52 G [5], v~g^,Wg^ G Tg^G"^,Vg^,Wg^ G 
Tg.G™ where Tg^TT{vgJ = Tg,7r(i)gJ and Tg^7T{wgJ = 
Tg^TT{wgf), we have 

5 G- (%! , tigi ) = 5 G- (^92 > ^92 ) ■ 



FARZIN TARINGOO: SYNCHRONIZATION ON LIE GROUPS 


5 


a sm( 0 /^) 



Fig. 1. Extremum seeking closed loop system 


Proof: We need to show that Gc acts as a group of 
isometries with respect to the Riemannian metric induced by I. 
Since gi,g 2 e [p], there exists gc e Gc such that p 2 = <7c*Pi- 
Then it is sufficient to show 


I(%5l ^{Vgi)^Tgi9l ^{Wg^)) = 

(5c*5l) ): (t7c*5l) ^giSc('li^gi))' 

(14) 


Hence, the statement holds if 

'^gi9i ("^gi) ~ ^gc*gi (ffc*5i) '^gi9c{vgf), 

which is trivial since gf^*gf^*gc*gi = gi"^*gi- The statment 
above proves that Gc acts isometrically on G™ and the proof 
is complete. ■ 

By employing the results of Lemma we define the 
induced Riemannian metric on the quotient manifold G™’ jGc 
as follows. For tangent vectors Vg,Wg e TgG'^jGc define 
5 G™/G,(^^g,«^g) = 5 G-('^[g],), where ■0[g],i£i[g] are the 
unique horizontally lifted tangent vectors in T[g]G'" corre¬ 
sponding to Vg and Wg, see p^ . Note that [p] is a subset of 
G"* and not necessarily a single point in G"*. However, with 
no further confusion we accept the notation T[g]G'" as the 
tangent space of all elements in [p] on G"*. 

Any smooth invariant function J : G™ ^ E, induces a 
smooth function J : G'^jGc E such that J = J o tt. 

The horizontal lift of the gradient of J in G'^jGc is the 

H 

gradient of J in G™. That is to say gradgJ = grady^J, g e 

G"^ I Gc, where ^ gives the horizontal lift of the tangent vector 
gradgJ e TgG'^ jGc- For detailed discussion on the horizontal 
lift and the equivalence of the gradients in the base manifold 
and the quotient manifold see p2) , chapter 3. 

IV. Extremum seeking algorithm for 

SYNCHRONIZATION 


the integrator is x, where x = x + asin(a;f). The dynamical 
equations in x coordinates are given by 

x{t) = kasin{u}t)J{x{t) + asin{ujt)), (15) 

where without loss of generality we assume fc = — 1. 


A. Averaging of the synchronization vector field 

As known pT| , on average, the dynamical system 
behaves as a gradient algorithm. Under technical assumptions 
for the dither signal, it is guaranteed that the state trajectory x 
converges to a neighborhood of an optimizer point of J, see 
12^ , p4) . This neighborhood is shrunken by adjusting the 
magnitude and the frequency of the dither signal, see | |23) , 

Pi. 

Consider an n dimensional Riemannian manifold {M,gM)- 
For any x e M, we consider the following local time-varying 
perturbation (geodesic dither) 


n 

Xp{t) = exp^ ^ m sin(wjf) 
i=l 


_ 5 _ 

dxf 


0 ^ Uj, 


(16) 


where i = 1, • • • ,n, are the basis for the tangent space 
at X. As defined before, exp^ v, u e is a geodesic 

emanating from x e M with velocity v. In this case we per¬ 
turbed different coordinates on M with different frequencies 
uji, i = - ■ ,n. The optimization of J on M is carried out 

by the state trajectory of the following time-varying vector 
field on M. 


f{x,t) = - 2 aiSin(u;if)J(exp~ ^ aiSin(wjf) 
2=1 2=1 
f{x,t) e Ts;M, i = 1, • • • ,n, 



dxi ’ 

(17) 


where the optimizing trajectory i:(-) is a solution of the time 
dependent differential equation x(f) = f{x,t) e T^M. Note 
that the magnitudes a^, i = 1, ■ ■ ■ ,n, are selected such that 
lli;r=i«*sin(a;,f)^||g < i{M). 

This algorithm is generalized for the synchronization prob¬ 
lem defined above. In this case each agent updates its state 
via 

n 

Xg = — 2 ai sin(a;if) x 

>expg,^ J = I,--- ,m, 

(18) 


and the state of agent j is computed by 


n 

Xj(t) = exp~^(t) 2 sin(a;^f) 

i=l 


dxi’ 


j = !,■■■ ,m. 


Note that in this algorithm the cost function J in ( [T8] l contains 
all the perturbations induced by all agents. 


An extremum seeking closed loop is shown in Figure 
This is the simplest form of the extremum seeking algorithm 
to minimize/maximize a scalar function J : E E. The 
dither signal asin{ujt) provides a variation of the searching 
signal x{t) in the one dimensional space E. The output of 


Remark 1. As is obvious, the optimization algorithm 
requires only information about the cost function J at each 
time t. This makes the implementation of the decentralized 
algorithm independent of the state of other agents and con¬ 
sequently from the topology of the network. However, it is 
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required that all agents have access to the synchronization 
cost at all time. ■ 


Remark 2. We note that {18\ is formulated with respect to 
a generic Riemannian metric qm cmd does not depend upon 
the embedding Euclidean space. This is a major distinction 
between our method and the algorithms presented in 
& The choice of the Riemannian metric gM affects the 
entire geodesic curves on M and different metrics will result 
in distinct optimization trajectories. ■ 


The algorithm presented in (18 1 is developed for optimiza¬ 
tion of cost functions on Riemannian manifolds and with no 
modification can be employed for optimization on Lie groups. 
We accept the following assumptions for the synchronization 
algorithm and the cost function on the Lie group G"" intro¬ 
duced before. 


Assumption 1. (i): Assume ujj = ujuif, w > 0, where the 
frequencies = I,-- - ,n,j = I,-- - ,to are distinct, 

rational and not combination of each other as Cof A wf, 
A oji and A wf -I- for distinct i,l,d e 1, • • • ,n 
and j,k,h e 1, - ■ ■ ,m. 

(ii): The synchronization cost function J : G™ —> IR is smooth 
and invariant with respect to Gc. Also J{g) is minimized if 
and only if g s Gc. 


Remark 3. We note that in order to implement an externum 
seeking algorithm, we need the uniqueness of a local minimum 
(maximum) for the cost function of interest, see This 

condition is obviously violated since the set Gc given in 0 
does not posses such a property. Ai is obvious Gc is a closed 
connected subset of G"* which is not necessarily compact. ■ 

The following lemma formulates the average behavior of 
the synchronization algorithm ( [T8] l on a Riemannian manifold 
(M, gxi)- Note that we present the results for general Rieman¬ 
nian manifolds where results directly apply to G™ which is 
the manifold of interest in this paper. 

Lemma 8. Consider the synchronization algorithm ( [7^| for 
agents moving on an n dimensional Riemannian manifold 
(M, ( 7 m)- Then, subject to Assumption^ at each x'^ e M"* 
and for each agent j, the average vector field of ( [7^| ) is 
in a perturbation form as 2 "=! ^ , a;j, • • • ) ^ -f 

where V is the Levi-Civita 
connection of i^M, Pm)- ■ 

In order to give the proof of Lemma we need to study 
the lifting of vector fields in product manifolds and relate 
the Levi-Civita connections of embedded submanifolds. As 
is obvious, the product space = M x • • • x M is 

a smooth manifold provided M is a smooth manifold. We 
consider the product Riemannian metric on which is 

given by pM™ = 5 m © • • • © 5 m- Note that there exists 
an inclusion embedding l : M ^ M'^ which is smooth 
in the product topology of M™, see GD, Chapter 7. Now 
assume X e X{M) then it is possible to locally extend X 
to a vector field X on M™. However, this extension is not 
unique and for any x e M, X and X need to agree on 


TxM, i.e. Xx = AJ, where is the projection operator on 
TxM with respect to gxi"'- Let us denote the local coordinates 
around x e M hy {xi,- ■ ■ ,x„). Hence, locally X is given 
by X!r=i where Xi are smooth functions, see il6). 

Lemma 4.2. By employing the local coordinates of the product 
manifold we may write the local coordinates of l{x) e by 
(xi, • • • , x„, 51 , • • • , 5 „(m-i)), where are local coordinates 
induced from In this case we consider a particular 

local extension of X given by 


n 3 n(m-l) . 

Y, of. 

i -^x, dy. 


(19) 


around t(x) e M™. This defines a local vector field on M™. 
The product metric of TVL™ guarantees that gM{X,Y) = 
gMr^{X,Y), i.e. t is an isometric embedding. 

Corresponding to the product metric, we have the Levi 

p 

Civita connection V on TIL"*. The Gauss formula , see 115 

p 


Theorem 8.2 gives the following relationship between V and 
V on and M respectively. 

Lemma 9 (Guass formula, | [T5| , Theorem 8.2). If X,Y e 
X(717) are arbitrarily extended to X,Y e ©(M™), then 

VxY = XxY + IIiX,Y), 

where 77(-,-) is the second fundamental form of M. ■ 

The following lemma shows that for the particular extension 
the second fundamental form II vanishes. 

Lemma 10 ( p^ , exercise 6.1). If X,Y e X{M) are locally 
extended to X,Y e X(M™) based on {19), then 


X 


Y = VxL. 


By employing the results of Lemma 10 with no further 
confusion, we only consider the extension of vector fields 
given in (19 1 and denote the extended vector field X hy X. 
The proof of Lemma is given as follows. 

Proof: (Lemma 

The proof is based on the Riemannian structure of product 
spaces and the Taylor expansion of J on M™. By employing 
the results of LemmapOl we have the following decomposition 

p 

for V. 


7=1 7=1 


( 20 ) 


where Yj,Xj e X{M) and V is the Levi-Civita connection 
of (TIL, 5 m)- Note that JfJLi Aj,XiJLi Yj are vector fields on 
M"* with respect to the extension introduced in ( [T9| ). Based 
on ( 181 , each agent j perturbs its current state Xj by the 
geodesic exp,^^. a:^ sin(a;^f) ^ which is the evaluation 

of the geodesic curve = exp^. Off'll al sin(a;ff)^ 

at 5 = 1. The geodesic curves yj{9,i),j = 1, • • • ,m induce 
the curve T{9,t) = ( 7 i( 5 ,f),--- ,^^{9,1)) e M*”. Note that 
9 is the parametrization of the geodesic yj on {M,gM) and t 
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appears as a parameter in the vector field which generates jj. 

p J I 

By the properties of V given in (20 1 , we have 


p 

V 


rie,t) 


m 

7 = 1 


where ^ and V,t) = 0 since 7 ^ are 

geodesics on This implies that T is a geodesic on 

M™. This is due to the special product metric of and is 
not necessarily true for all Riemannian metrics on M™. 

Then the Taylor expansion of J along the geodesic 
exp^„ ex, where = {xi,-■ ■ ,Xm) ^ M™, X e 
is given by (see ph]) 


nfc —1 


J(exp,„ OX) = J(x™) + 6{VxJ){xn + - + 7 -TT, x 

(n- 1)! 

(V^ 'J)(ai-) + £(1 - sex)ds, 

o<e<e*, ( 21 ) 


which is equivalent to 

J(exp,„ 9X) = J{xn + eidJ{X))\,rr. + ... + ^2^ X 

p k —2 ^k pi p k — 1 

(V^ dJ)(X)U™ + ^^-^|(l-s)'=-i(V^ dJ){X) 

{exp^m. seX)ds, 0<9<9*, (22) 

where dJ : TM'^ ^ E, is a differential form of J, 9* is 
the upper existence limit for geodesics on M™. Note that for 
compact manifolds 9* = co. 

Hence, the expansion above along the geodesic curve r(0, t) 
gives 


j(r(i,t)) = J(r(o,f)) + (VxT)(r(o,t)) + 


1 1 p 

(Vx J)(r(o,f)) + ^^^|(i-5) 


k — li 


(fc-l)! 
J(r(s, t))ds, 


{k- 


X 


where X = XiJLi Sr=i which is due to the 


structure of © • • • © and r(0, t) = 

x^. 

Linear properties of V imply that (see GH) 

n 

= E < sin(a;^f)V^ J. 

* 2=1 

By @ we have 


S7L1 sr=i aj sin(wtt) 


J = y y sin(a;ff)V_^ J, (23) 

j=ii=i 


where J in the right hand side of (23 1 is restricted to M. 
Iteratively we have 


'117=1 11i = i “i sin(w^t). 


, fc— 1 


y y sin(u;^f) V ^ ^ 2r=i' 

i=li=l 




p k—1 

where is decomposed on 

Tx^M, j = !,■■■ ,m. 

We drop the notation " for the state trajectory in (I 81 . 
Hence, the synchronization algorithm (I 81 and the dynamical 
equations for the extremum seeking feedback loop are given 
in X coordinates as follows: 


n ps 

= “(y sin(a;ft)j(a;'")— + 


d 


y y a-afsin(a;ff)sin(a;ff)V a J(a;’”)—+ •• •+ 

e=li,Z = l 

-l m n 

y y ay?sin(w^f)sin(wff) x 


k-2 






1 




y a^sin(u;^f) 


2 = 1 


I ( 1 -»)'■-vsrx 

n ri /i 

J{-" >exp^, sy a 7 sin(a;ff) —,---)ds)—). (24) 


r=lSr=ialsin««)a|- 

d 


The vector field above is a time varying vector field on M 
for each agent j. Since the perturbations appear in the form 
of sinusoids then by Assumption [T] the resulted vector field is 
periodic with respect to time. By employing Assumption 
the averaged vector field for agent j is given by 


xYafv^J{xn^ + --- + 

2 " a.; ' ' ^X^ 

rT 


1 1 i,L,L 

tJo [ (fc- 1)! ^ 2 ayfsin(w^f)sin(wff) X 
1 ” . 

^^^y a^sin(a;ff)| 

Jo 


1 : 7 = 11 : 7=1 -i 

dXi' 


■/(•••, exp,^ s y a\ sm{wi > ’ ’ ’)^j 
2=1 


dt. 

(25) 


We observe that each agent can select its geodesic dither 
amplitudes af, j = I,-- - ,m,i = I,-- - ,n such that 

II X;r=i < Kxj), where i(xj) is the objec¬ 

tivity radius at xj e M, see Definition [6] It is guaranteed 
that i{x) > 0 for all x e M, see |l9f . Hence, the set 
exp^,^. Bi(x,){0) = exp^^ Bi(^^.)(0) is compact in the topolo gy 
of M. This results in the compactness of exp^^ Bi(^xi){0) x 
••• X exp^^ in the product topology of M™. 

By the choice of dither frequencies and Assumption [T] 
we have T sin(a;^f) sin(a;ff) sin(a;®f)df = 0, j,k,q e 
1, • • • ,m,i, l,r B 1, ■ ■ ■ ,n. Together with the smoothness of J 
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and compactness of exp^^ x • • • x exp^^ 

this implies that the only signihcant term after the integration 
in i25\ is of order 0(maxjg{i... „} ... „} |a^ l'^). Conse¬ 

quently, the averaged vector held for each agent is in the form 
of a perturbation in the statement of the lemma and the proof 
is complete. ■ 

Remark 4. The order of the perturbation vector field con¬ 
structed above is not uniform with respect to M'^, since 
the injectivity radius may vary on Riemannian manifolds. 
However, in the case that i(M) is bounded from below the 
perturbation term in \25\ can be uniformly bounded. This 
specially holds for compact manifolds since the injectivity 
radius of compact manifolds are bounded from below, see 
Lemma |i] 


B. Stability of the gradient system on G™' jGc 

As stated in the previous section, the averaged vector held 


of each agent is in the perturbation form represented in (25 1 . 
The results of Lemma [ 8 ] also hold for G™ instead of M"* 
since by dehnition Lie groups are smooth manifolds. We dehne 
the gradient system of the synchronization problem on M™as 
follows. 


Dehnition 9. For the synchronization extremum seeking al¬ 
gorithm the gradient vector field on is given by 

laf V a e X(M-). 


Note that Xii=i ^ for which we 

consider their unique extensions presented in ( [T9| on M™. 
As stated before the synchronization cost on G™ has a set 
of minima denoted by Gc c G™. In order to analyze the 
synchronization problem on G™ we modify the extremum 
seeking vector held ( [T8] l to be applicable on Lie groups. The 
extremum seeking algorithm for the synchronization on G"* 
is given as 


“i sin(w,f) 


J = 1,- 




,9j* exp(^ aj sin(w^f)^), 


(26) 


where exp is the exponential map on Lie groups dehned in 


(10 1 and f— are the base elements of C. In this case we employ 


the left invariant vector held, denoted by 9j-^, induced by 
^ on £ given by Teg{-^). One may show that Te(pi * 
52)(^) = Tg^9i oTeg 2 {^) which shows that T^g{-^) is 
left invariant. Note that the exp curve is not necessarily a 
geodesic on G. It is shown that in the case which G admits a 
bi-invariant Riemannian metric the exponential curves through 
e are geodesics, 1271. In this case it is easy to show that y{t) = 


g * exp(fAr), X e £ is a geodesic through g e G since 

^ dexp(fX) ^ 

g*e.xp(tX)f]^ dexp(tx) U, 


since exp(fX) is a geodesic and V dexp(tx) = q. Note 

that V is the corresponding invariant connection with respect 
to the Cartan-Schouten (0) form on G, see | |Z7l - Hence, the 
analysis o f ([26] l is exactly the same as the analysis of ( fTS] ) 
in Lemma [ 8 |However, a bi-invariant Riemannian metric may 
not exist for all Lie groups. As an example SE{3) does not 
admit such a metric and consequently the exponential map 


on SElfi) is not a geodesic, see |27|. In the case that G 


does not admit a bi-invariant metric, we employ the Taylor 
expansion of smooth functions on G and replace (0 by 
its version on Lie groups, given in | [2^ . The rest of the 
analysis remains unchanged where VxJ{.g) is replaced by 
XJ{g) = limj^o 

The stability of the extremum seeking algorithm ( |26] l is 
related to the stability of the gradient system in Dehnition 
1^ As explained, the synchronization cost function has the set 
of minima at Gc = {( 5 , • • • , 5 ) e G"*} for all g e G. First we 
shows that the gradient system of the synchronization system 
in Dehnition 1^ gives a left invariant vector held on G™. 

Lemma 11. Consider the gradient system of the synchro¬ 
nization extremum seeking algorithm ( |26p which is given in 
Definition^on G™. Assume J satisfies Assumption^then the 
gradient system is invariant with respect to Gc on G™. 

Proof: Applying the analysis of the proof of Lemma 
implies that the gradient system of ( [26| ) is in the following 
form 


Hi IL -i 

j=ii=i 


(27) 


The left invariance of the vector held gj-^ is immediate. 
Also S7g._^J{g"^) is Gc invariant since for a general left 
invariant vector held X e X(G'") we have XxJ{g^) = 
{X{J)){g"^). Together with the invariance of J with respect 
to Gc, this implies that X{J){g^) = X{J){gc*g^). This is 
due to the fact that (see ( | 2 T] l) 


xJ{gc* 9^' 


= lim 
t-.o 

= lim 

i -.0 


J{.9c*9'^* exp tX) - J {gc*9'^) 


J(p’”*expfX) — J{g^) 


= VxJ(5'”)- 


(28) 


Hence, the gradient vector held for each agent j is Gc 
invariant. ■ 


Remark 5. The second equality in ( |2(Sp does not necessar¬ 
ily hold along geodesics since in general exp^^^^^™ tX A 
gc* exjpgm tX. In this case we may not be able to use the 
invariance properties of J with respect to Gc. ■ 

Theorem 3. Consider the gradient system of the synchro¬ 
nization extremum seeking algorithm ( |26p which is given in 
Definition j^for all agents on G™. Assume J is positive, Gc 
invariant and J(p) = 0, g e Gc. Then, if the initial state 
TT^g'^ifo)) is sujfciently close (in the quotient topology) to 
7r(Gc), then the state trajectory of the induced gradient system 
on G'^ jGc initiating from 7r(5™(fo)) asymptotically converges 
to 7 r(Gc) e G™/Gc. 
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Proof: By the results of Lemma [TT] the gradient vec¬ 
tor held is Gc invariant and consequently induces a vec¬ 
tor held on G^/Gc- The vector held in ([28]) induces 


a vector held g, 


G^/Gc. The cost function J induces a smooth function 
J : G"^IGc R via J = J o tt, where by using the the 

H 

horizontal lift, we have gradgJ = grad^g^J, g e G'^jGc, 
see p2) . Since J is a single valued smooth function, based 
on (jsjirfor X e X(G'") we have VxJ = X{J) = dJ{X) = 
gC’^igradJ, X). The operator Tgm is linear and therefore the 
induced vector held denoted by X is evaluated at 7 r(p”*) by 

m n -| ^ 


3 = 1 ^ 

^ ^ 1 2 ^ ^ 

“ E E 9G^i9radgrr,J,gg—)Tg^TT{gg—) = 

™ " 1 2 „ d 

“ E E 9 ®* 5 G™/G.(<?™rf,r(s-)i,Tg,. 7 r(gg—)) X 


J=lz=l 




m n ^ 

-eeJ 

J=lz=l 


ai V„ 


^92 a ) 


J{TT{g"^))Tgrr.Tr{gj^), 

(29) 


where V is the Levi-Civita connection of GmIGc- Since 
Jig) = 0,g e Gc then J o nig) =0, g B Gc- Note that for 
all gi,g 2 e Gc we have 71 ( 51 ) = 71 ( 52 ), hence Gc maps to a 
single point 7 r(Gc) in G'^jGc- It is immediate that 7 r(Gc) is 
a unique local minimum of J since for any 5 ^ 7 r(Gc) we 
have 7r“^(5) n Gc = 0 . Otherwise there exists 51 G 7r“^(5) 
such that 5i = (511, • • • ,511) G Gc- Since 51 ~ 71-1(5) then 
for each 52 G 71 - 1 ( 5 ), there exists gc e Gc such that 52 = 
5 c* 5 i. This implies 71 - 1 ( 5 ) = Gc or 5 = 7 r(Gc) which is a 
contradiction. We consider J as a candidate Lyapunov function 
on G^/Gc. The time variation of J along the induced gradient 
vector held (|29]l is given as 


J = dJiX) 

As is obvious Jj(j'g^'^{9j'^ 
V„ ( , \ J( 7 r( 5 ™)). Hence, 


J(^(5'")) X 




^92 47 )' 


m n 

1 • 1 ^ ^9 

3=11=1 


[gj 


— ) 


J(^(5’")) < 0 . 


Since 7r(Gc) is the unique local minimum of j then 
7 a ) JKd"^)) = 0 if and only if 5 ™ G Gc- This 

2 3 ™ {gj Bgi } 

yields that J locally vanishes only at 7 r(Gc) G G'^jGc- By 
employing the Lyapunov stability results on manifolds, see 


1211 , 7 r(Gc) is locally asymptotically stable on G™/Gc and 
the proof is complete. ■ 

One may show that asymptotic convergence of the state tra¬ 
jectory of the induced gradient system in the quotient manifold 
G'^/Gc results in the asymptotic convergence in G™. Consider 
the curve 7(f) = 7r(<i>x(f, fo,i?”^)) on G™/Gc, where ihjf is 
the how of X on G™, see (§. To show the convergence in G™ 
we need to show 7(f) = 7(4 = fg, 7 r( 5 ™)) in G^/Gc, 

where is the how of X on G'^jGc- To this end, it is 
sufficient to prove both of them are integral hows of the same 
vector held with the same initial conditions. Obviously both 
7 and 7 initiate from the same initial state 71(5™) G G™/Gc 
and $^(f,fg, 7 r( 5 '")) is the solution of the vector held X 
on G^/Gc. The tangent vector held along 7 in G™/Gc is 
obtained by 


7 W = T<s>x(t,to,g^)'^Xi<^xit,to,g"^)) 

= Xini^xit,to,gn)), 


(30) 


where the second equality holds since X is the horizontal lift 
of X, see IE}- Equation ( |30| shows that 7r($x(f, 5 ™)) 
is the solution of the vector held X in G'^ jGc with initial 
conditions 71 ( 5 ™) G G'^jGc and Xi^ig^)) e TT^i^gm-^G'^jGc- 
Hence, by the uniqueness of solutions for Hows we have 
7(4 = fit). As stated by Theorem]^ if 71 ( 5 ™) is sufficeintly 
close to 7 r(Gc), then $^(f,fg,71(5"*)) ^ 7 r(Gc). Hence, 
together with continuity of tt in the quotient topology, we have 
^xitjto, g"^) Gc- This is summarized in the following 
proposition. 

Proposition 1. Consider the initial state 5™ G G"* such 
that $^(f, fg, 71 ( 5 "*)) —> 7r(Gc), where X is the induced 
gradient vector field ( |29j ) and is its flow as per (j^. Then 
it,to,g) —> Gc, where Xg is the gradient vector field 

■ 


C. Closeness of solutions on G'^jGc 

To analyze the behaviour of the extremum seeking algorithm 
( |26| ) on G™ we need to study the closeness of solutions 
of perturbed vector helds on G™. As stated by Theorem 
[^ for sufficiently close initial state 71 ( 5 "*) the state How 
(f, fg, 71(5"*) converges to 7 r(Gc). However, the original 
state trajectory $x(f,fo, 9 ™) converges to the invariant set Gc 
which is not a single point. To obtain the closeness of solutions 
for state trajectories of ( | 2 ^ and its corresponding gradient 
system in Dehnition [^ we study their projected trajectories on 
G^jGc- 

Lemma 12. Consider the synchronization extremum seeking 
algorithm ( |26f on the connected Lie group G™ such that 
j(G"J.) ig bounded from below. Then the averaged vector field 
of the synchronization extremum seeking algorithm, Xa, is Gc 
invariant and there exists a continuous function p : K, —> 
IR, p(0) = 0, such that 


limsup(i($x0f,fo,9”'),Gc) < 

t —>00 


p( 0 ( max 

zefl,--- ,m} 


J 1 4 


))• 






10 


IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. XX, NO. XX, 2015 


Proof: As shown by Lemma the averaged vector 
held is the perturbation of the gradient system dehned in 
Dehnition Let us denote the time varying synchronization 
vector held in (j2^ by X{g,t). Since J is Gc invariant and 
5 ^ are left invariant then it is immediate that for each t, 
TggcX{g,t) = X{gc*g,t), gc G Gc- Since X is T periodic 
then X{g,T)dT is also Gc invariant. By the results of 
Lemma [ 8 ] we have 


Xaign = 


m n 

- E E 




_d_ 

dgi 


m n 






max 

.m} 



Hence, the induced vector held on G"^ jGc is given by 


X„(7r(p™)) = Tg™7r(X„(5-)) = 

( m n 1 P) \ 


Tgr^i: 


rri ri ^ \ 

''.m} dg^ J 


As shown by Theorem the induced vector held of the 
gradient system is locally asymptotic stable around 7r(Gc)- 
Hence, X is a perturbation of an asymptotic stable vector held 
on G”YGc. By employing the results of p^ , there exists a 
continuous function p : R R, p( 0 ) = 0 , such that 


limsupd($^ (f,fo, 7 r(p™)), 7 r(Gc)) 

t—*O0 \ “ / 

p{0{ max Ja^h). 


< 


(31) 


Connectedness of G"^jGc implies that there exists a piecewise 
smooth 7 : [ 0 , 1 ] ^ G"^jGc such that 7 ( 1 ) = 7 r(Gc) 
and 7 ( 0 ) = <i>j^ (f, fo, 7 r(p'")). Results of Proposition 
11,3.1 yields the existence of the unique horizontal lift of 
7 (-) denoted by 'j(-) e G™, such that Ty(t) 7 rj(t) = j(t) 
and 7 r( 7 (t)) = 7 (f). Since 7 (-) is a horizontal of 7 (-) then 

^(7) = io5G’"(7W>7M)^'^ = Io5S-/Gc(7('r),7(T))rfT = 
^( 7 ). Therefore, 


to,gn, Gc) ^ to,gn,7(1)) = 47 ), 


where d(^x(t, to, g'"), Gc) = infg^G, cl(^x(t,to,g"‘),gc) 
and 7 ( 1 ) e Gf- By the Riemannian structure of G^/Gc 
and continuity of p, select at sufficiently small such that 
p(0(max,g{i_... .m} laj l'^)) < i{7r{Gc)), where i{Gc) 

is the injectivity radius at 7 r(Gc) in G"^ jGc- One may choose 7 
as the radial geodesic in a normal neighbourhood of 7 r(Gc), see 
||r5| . This implies that d(^j^ (f, fo, 7r(p™)), 7r(Gc)) = ('( 7 )- 
Hence, by 


limsupd($xY^>^o,5”"),Gc) ^ 

t—^OO 


p(0( max 


J\4: 


)), 


which completes the proof. ■ 

The next theorem is the main result of this paper which 
gives closeness of solutions for state trajectories of dynamical 
systems on G™. 


Theorem 4. Consider the synchronization extremum seeking 
system given in ( |26| ) on G™. Subject to Assumption for any 
neighbourhood G,r(Gc) G™/Gc of tt(Gc) on G'^jGc, there 
exist a neighborhood Ut^(^g7) ^ G"^ jGc of'n(Gc) such that for 
any g^ e G™, 7 r( 5 o”^) e there exist sufficiently small 

parameters aj, i = 1, - ■■ ,n,j = 1, - ■■ ,m and sufficiently 
large frequency uj, where the projected state trajectory of the 
closed loop system in (261 on G’^fGc ultimately enters and 
remains in G 7 r(Gc)- 


Proof: We analyze the closeness of solutions between 
state trajectories of p 6 | and the state trajectory of the gradi¬ 
ent system on the quotient manifold G”^/Gc. As stated in 
Assumption the geodesic dithers frequencies are ojl = 
ujuij, j e (1, • • • , m), i e (1, • • • ,n). In the time scale t = ojt 
we have 


dgj 

dr 


■ - E “i sin(w*T) 


X 


IT p) p) 

J{--- ,gj* exp(2 sm{uif 
= -X(T,g^)eTgr.G^, j = !,■■■ ,m. (32) 

UJ 


By the results of Lemma the averaged dynamical system on 
G"* is given by 




LO ^ 2 

J=11=1 


dgi 


— o( m; 


max 

,m} 


= -Xaign^Tgrr^G"^, 

UJ 


5gi 


(33) 


which is in a form of a perturbation of the gradient vector 
field -hi:7=iYP=i iaf on 

G"*. As stated in the proof of Lemma [T2| the synchronization 
extremum seeking system ( [3^ is left invariant with respect to 
Gc and consequently induces time varying vector held X, time 
invariant averaged vector held Xa and the induced gradient 
vector held Xg on G"^jGc- Hence, we analyze closeness of 
solutions among the state trajectories of -X, -Xa and -Xg 
on G^/Gc- 

Consider the periodic vector held Z(t,x) = '^^(Xa(g) — 
X(g,T))dT, g e G™/Gc, A e R;.o, where Z(t,g) = Z(t + 
T,g). Now consider a composition of Hows on G'^fGc given 
by 


(1.0) 


z(t) = o<^LxU',To,go) 
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The tangent vector of z is computed by 

W Jo 

(34) 


where (4) is the pullback of the state flow and 

e = -. See pi), |31| for the definition of pullbacks along 


diffeomorphisms. Equivalently, in a compact form, we have 


Hr) . 1 [(*-)<■'”>• 

cj L 


X 


+ f {<i>-^)^l'f{Xa-X)ds\oz{T) 
Jo ^ -I 


UJ UJ 


(35) 


One can see that H{0, r, x) = f{x) where by the construction 
above, H is smooth with respect to U By applying the Taylor 
expansion with remainder we have 

= Xa{g) + -h{g,C,T), 

UJ UJ 

where h{gX,T) = ^H{^,T,g)\^^^ and C 6 [0, We 

note that H{^,T,g) is periodic with respect to r since X{g,T) 
and Z{T,g) are both T-periodic. Hence, h{gX,T) is a T- 
periodic vector held on M. 

The metric triangle inequality on G™‘ jGc implies 


d(fl>i^(r,ro,5o),4>i^jT,ro,5o)) < 

d{‘^zx{T,To,go),<^^l'°^ o $i^(r,ro,5o)) 

ofl>i^(r,ro,go),^ix„(T,To,go)) < 
d{‘^Lx{T,To,go),‘^^lf o ‘^Lx{T,To,go)) + 
d{<^^lf o $i^(r,ro,a;o),7r(Gc)) + 

d{^LxS^Xo,go),T^iGc)). (36) 

Based on ([36}, We analyze the closeness of solutions for 
the following dynamics on G’^jGc- 






\ jGl)"' ,n 

\j=i ^=^ 


9j 


dgi 




/ 771 n 


\j=i 1=1 


max 

jel,--- ,n 


9j^] + -H9,C,t), 
cgij w 

where 5 (^ 0 ) = ffo and g = 71 ( 5 ™) e G'^jG^. 


(37) 


The variation of the induced cost function J along Xa = 

Xg+Tgrr^TT (i; 7 = 1 Iir= 1 ^ ( (mUX^e 11 ) ^ ) ^ 

is given by 

^ £r=i 0((maxj,= i,... 

where by the results of Theorem we have Cx J ^ 0. 
Without loss of generality, assume positive definiteness and 
negative semi definiteness of J and J are both obtained 
on the same neighbourhood on G’^jGc- Otherwise we ap¬ 
ply the intersection of the corresponding neighborhoods to 
perform the analysis above. The sublevel set Mb of the cost 
function J : G'^jGc Hgto on G'^jG^ is defined by 
TVf, = {p e G^jGc, J{g) < h). By Nb{g*) we denote a 
connected sublevel set of G"*/Gc containing g* e G'^jGc- 

By Lemma 6.12 in lED, there exists a compact subslevel 
set A/'b( 7 r(Gc)) c such that A 4 ( 7 r(Gc)) is compact. 

Consider a neighborhood WCer; i ^ A 4 ( 7 r(Gc)) c Urrta v 
The set M(>e(GJ) - = M,(,(Ge)) 

compact since is closed and A/b( 7 r(Gc)) n^w(Gc) ^ 

Nbi'n'iGc)) is a closed subset of the compact set A 4 ( 7 r(Gc)), 
which is consequently compact. 

Compactness of Nb {it{GJ)) - 1E,(g.) 


and 

continuity of the 

perturbed 

vector field 

Tgr. 

^fc”LiI]r=iO((max,ei,.. 

• ,n 


on 

G’^jGc together imply that 

by selecting 

•> 

j = I,-- - ,m,i = 1 ,- 

• • , n sufficiently small we 


have Cx J < 0 on A4 ( 7 r(G,)) - VE^(g,). This implies that 
the state trajectory g{-) initiating inside NbU^iGc)) remains 
in A 4 ( 7 r(Gc)). 

The variation of J along Xa {g) + ^^{9: C) given by 


^JX„-|-i/t(g.C.Gj)'^ “ 3^ ^Gh(gX,t)J — Gx^ 

^Tgm 7 r( 2 ”li S?=i 0((maxjei,... o^)^)gj gfr) 

+ lj^HgX,t)d- 


J + 

J 

(38) 


The same argument applies to the variation of J along 
Xa{g) + ^d{gX,t) and for sufficiently small af and suffi¬ 
ciently large uj the state trajectory of ^ = Xa {g) + ^h{g, t) 
remains bounded in Nb{x(Gc))- 

Denote the uniform normal neighborhood of 7 r(Gc) e 
G'^jGc with respect to Urr(Ga) existence is 

guaranteed by Lemma 5.12 in |[T5|). Consider a geodesic ball 
of radius 6 where ^ c exp^(-Gg)( 7 ? 5 ( 0 )). By definition, 

exp^(-Gg)( 7 ? 5 ( 0 )) is an open set containing Tr{Gc) in the topol¬ 
ogy of G"^jGc- Therefore one can shrink b to b,0 < b ^ b, 
such that Nf^(TT(Gc)) c exp^(Ge)(-S 5 ( 0 )). Hence, we can 
select the set of initial state such as H--h('Jotgo) stays 
in a normal neighborhood of 7 r(Gc). Hence, without loss of 
generality we assume A 4 ( 7 r(Gc)) c exp,r(Gc)('®5(0))' 

Therefore, by employing the results of p9) , there exist 
a neighborhood ^ a int{Nb{x{Gc)) and a continuous 
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function p, such that 


piWTg^ir 


f m n 

Vi=li=l 


max al) )gj^ + 


Cj I Is) J 9Q ^ 


jEl,--- ,n 

1 


Sgi 


(39) 


where p is a continuous function which crosses the origin. 
Note that ( [39l l does not guarantee the convergence of the 
perturbed state trajectory to tt(Gc)- However, it gives a local 
closeness of solutions in terms of the Riemannian distance 
function d to tt{Gc) after elapsing enough time. 

By employing the triangle inequality we have 

d{<^x to,go),go)) ^ 


rf(^’x^ + i,,(i,io,5o),7r(Gc)) + (i(7r(Gc), fo, 5o)), 

(40) 


where in (40i, d{TT{Gc),^x (^i^Oj5o)) is ultimately bounded 
by Lemma T2 and d{^x +-h(^’ to, go),‘^{Gc)) can be chosen 


arbitrarily small by fn order to show the closeness of 
trajectories ^x{t,to,go) and fo)5o) in terms of 

d we switch back to the 

time scale r. To this end, we prove d('i>j_^(T, To,go), o 
^Lx{r,To,go)) = 0(4). Note that + tq, 50 )) = 

° ^xxiT,To,go)- First we show that $i^(-,ro,5o) 
remains in a compact subset of G™jGc. provided go e 
mf(A/b(7r(Gc))). As demonstrated by (38i by selecting 
at sufficiently small and lu sufficiently large, there exists 


such that for go 

$ 


G W, 


7r(Gc 


the state trajectory 


X +^At,to,go) remains in the compact set A4(7r(Gc))). 
Hence, 'Toi 5o)) remains in A4(7r(Gc))) since it 

is the same trajectory in r scale. Consequently we have 


U 4>i^(T,To,po) c IJ oA4(7r(Gc))) 

Te[ro,oo) r€[To,CB) 

U oA4(7r(G,))), 

re [tojCijT] 

where the equality is due to the periodicity of Z. This proves 
that for all go G W,r(Gc) trajectory tq, po) is 

trapped in the compact set Urelro uT} oA4(7r(Ge))). 

By the definition of the distance function given in 
we have d{<^:Lz{.s,0,g),g) ^ £($^^( 5 ,0,p),p), where 

^( 4 * 17 ( 5 , 0 , 0 )) is the length of the curve connecting q to 
$i^(s,0,g) on G^/Gc- Therefore, 


^($ 1 ^( 1 , 0 , 5 ), 5 ) ^ 


^(4>iz(l,0,g),g) = - 

^ UJ 


r \\Z{X,<^iz{s,Q,g))\\gds. 

Jo 

(41) 


Periodicity of Z with respect to A, boundedness of 
‘^±z(^,^,g), ® ^ [0i 1 ] in the sense of compactness of 


Urelro.cjT] o AT, (7r(Gc))) and smoothness of Z with 

respect to g together yield d(^AzA,0,g),g) = 0(4), g e 
J\fi,(7r(Gc))- Hence, we have 

d (4>i^(T,To,go),4>^2^^ o 4 >i^(t,to,po)) = O , 

£ ['r0i°o)j'?0 6 iUr(Gc)i 


where g is replaced by 4 >j^^(t,tq, po) £ G’^jGc- Hence, by 
using (361, for any go G 14^(g,,), there exists a time Tg^, such 
that 


d(4>i^(r,To,5o),4>i^jT,To,5o)) < 
d{^LxA^^o,go),^Az ° 4 ’ix(G 7 - 0 , 50 )) + 
di^Az ° 4’ix(G7-o,5o),4’ixjT,To,5o)) < 


d{‘^Lx{T,To,go),‘^Az ° 4 ’ix(G 7 - 0 , 50 )) + 
d{'^Az ° 4>i^(r,ro,5o),7r(Gc)) + 
d(7r(Gc),4>ix_^(r,ro,5o)) < O + 


/ m n 

P(IIU-77 220(( 


I.) 


max a: 

jel,--- ,n 


t)‘)9,4- I + 


L(9,<,',7)II,) + 

(jJ UJ 

/ / m n 


\j = li=l 

Vtg [wrgo,oo),po e W,.(g,), 




j'el,--- ,m, 2 Gl,--- ,n 


Iff > 


where p is derived by Lemma 

4’ix(L 7 - 0 , 50 ) = 4’x+i?.(^>^o,5o), 
Finally we have 
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Note that $ 


Tor T = Lot and tq 



d(4>i^(T,ro,5o),7r(Gc)) < 
d($i^(T,To,5o),4>ixJr,To,5o)) + 

d(7r(Gc),4>ix_^(r,ro,5o)) sS O + 


5(llU-77 2 2 0(( max ^^AAgj^ + 

-M5,C,-)llff) + 

CU LJ 

( m n P \ 

“^)‘‘)5ff^ llff, 

jel,---,n COj I 

j=ll=l / 

Vtg [LjTgg,co),go g 










FARZIN TARINGOO: SYNCHRONIZATION ON LIE GROUPS 


13 


Following the proof of Lemma we can show 


/ m n 


\j=i*=i 

LJ 




jel,--- ,71 


( m n ^ \ 

max a^i)^)93 -^]\\g. 

dgi J 


Vf G [Tg„,oo),7r(p™) e fL^(G,), 


which gives the closeness of solutions on G’" and completes 
the proof for 17^(0,) = ■ 



V. Example on S'0(3) 

In this section we present a simple example for synchro¬ 
nization of three agents evolving on 5'0(3) as their ambient 
state manifold. For this problem the synchronization cost is 
given by 

J : 5'0(3) X 50(3) x 50(3) ^ R, 

•7(51,52,53) = ^tr ((51 - 52)"^ • (51 - 52)) + 

^tr ((pi - 53)^ • (pi - gs)) + 

\tr ((52 - 53 )^ • (52 - 53 )), 51 , 52,53 e 50(3). 

(42) 


The invariant synchronization set is given by Gc = 
(5c, 5c,5c) G 50^(3), where one can verify that J{gc * 
5 i,5c * 52 , 5 c * 53 ) = - 7 ( 51 , 52 , 53 ) for all g^ e 50(3). 
Hence, J is Gc invariant. The Lie algebra so(3) is spanned by 



1 

0 \ 



0 

0 \ 


0 


II 


0 


\ 0 

0 

0 y 


\ 0 

-1 

0 / 


0 0 

0 0 

-1 0 


. For this example the dither vector X{e) at 


the Lie algebra so(3) is given by 


Xie) 




Ui sm{ujit) 


Sgi 


( 0 Oi sin(a;if) 03 sin(a;3f) 
—ai sin(a;it) 0 02 sin(a;2f) 

—03 sin(a;3t) — 02 sin((u;2f) 0 


(43) 


hence, the dither vector held is given by 


X{g) = 5- 


0 oi sin(a;if) as sin(a;3t) 
—oi sin(a;if) 0 a2sin(a;2f) 
—as sin(a;3<) — 02 sin(w2f) 0 


Fig. 2. Convergence of the synchronization cost function 



Fig. 3. Convergence of the first column of gi, g 2 i 93 


The extremum seeking for synchronization of the agents in 
this example is given by 


9j = - o-l sm(w*f) j{gi- exp(2 a\ sin(a;,H)— ), 
2 = 1 
3 


2=1 


52 • exp(^ a} sin(a;2 f)—) 


2=1 

3 


dgi 

d 


53 •exp(^afsin(a;ff) —)^ 5 j —,j = 1,2,3. 


2=1 


(44) 


5i 


The initial conhguration of agents are given by 
' -0.3766 - 0.8917 0.2509 ' 

0.7877 - 0.1658 0.5934 

-0.4875 0.4211 0.7648 


where g e 50(3). 


52 
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which is used for robotic modeling. We have 


SE{3) = { 


gSO(3) 

0lx3 1 


G R' 


4x4| 


gSOi3) ^ SO{3),g^ 


where models the rotation and g® models the trans¬ 

lation in The Lie algebra of SE{3) which is denoted by 
se(3) is given by 


se(3) = 


S V 

0lx3 0 


gR^^^I 5g so(3),t;G R3}, 


Let us consider the synchronization cost function for three 
agents as J : SE^{3) R, which is given by 


Fig. 4 . Convergence of the second column of 51,52,53 



Fig. 5 . Convergence of the third column of 51,52,53 


-0.5569 0.8229 0.1122 
-0.6528 -0.5173 0.5534 |,g3 

0.5134 0.2350 0.8253 
-0.6536 - 0.7568 0 \ 

0.5788 — 0.4999 — 0.6442 j. Figure 2 shows 

0.4875 - 0.4211 0.7648 / 

the convergence of the synchronization algorithm in 
terms of minimizing for a proper set of frequencies 


= 1,2,3. Figures 
91,92,93 on S'03(3). 


3i5 


show the synchronization of 


VI. Example on SE{3) 

In this section we give another conceptual example for an 
orientation control on SE{3). 

As is known, SE{3) is the space of rotation and translation 


Ji9) = 


-tr 




gSOi3),r 


y ■ ur 


Itr 


93 IIr3- 


SO(3) 


30(3) 

92 




SOi3).T 


2 93 ') ' (92 

2 ll^" 


R||2 I 
R3 + 


+ 


S0(3)_^S0(3)A 


?°(3)_ 5^0(3))) + 


(45) 


The synchronization set for this problem is given by Gc = 
(9c, 9c, 9c) s SE^(3). One can verify that Gc is invariant for 
the cost function(|45|). Since the group operation on SE{3) i 
given by matrix multiplication then we have 


IS 


9c ■ 9j 



It is immediate that the rotation terms in ( |45| l are invariant 
with respect to SO(3). Also the displacement terms are given 

by k\\9c°^^^-gy + 9f-9c^^^^-9f-9ni^ = ill^f 

Hence, is Gc invariant. 


-5fl 


The Lie algebra se(3) is spanned by 


/ 0 

1 

0 

0 

\ 


( 

0 

0 

1 

0 

\ 

-1 

0 

0 

0 


B ^ 


0 

0 

0 

0 


0 

0 

0 

0 


’ Bg2 


-1 

0 

0 

0 



0 

0 

0 

/ 


V 

0 

0 

0 

0 

J 

/ ® 

0 

0 

0 


\ 

( 

0 

0 

0 

1 

\ 

0 

0 

1 

0 


B ^ 


0 

0 

0 

0 


0 

-1 

0 

0 


’ Bgi 


0 

0 

0 

0 


\ ° 

0 

0 

0 

> 


\ 

0 

0 

0 

0 

J 

/ ° 

0 

0 

0 

\ 



0 

0 

0 

0 

\ 

0 

0 

0 

1 


and y- = 

Bge 


0 

0 

0 

0 


0 

0 

0 

0 



0 

0 

0 

1 


V 0 

0 

0 

0 

/ 


\ 

0 

0 

0 

0 

J 


B 

9gi 


B 

Bgs 


Bg5 


For this 


example the dither vector X(e) at the Lie algebra se(3) is 


2 

R3- 
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given by 


^(e) = ^ ai sin(a;it) — 


2=1 


( 0 aisin(a;i<) 03 sin(a;3i) a4sin(a;4t) \ 

—oi sin(a;it) 0 02 sin{uj2t) as sin(a;5t) 

—03 sin(a;3t) — 02 sin(a;2t) 0 
0 0 0 


06 sin(a;6i) 
0 


hence, the dither vector field is given hy X{g) = g ■ X{e), 
where g e SE(S). 

Similar to the example on SO{3), the extremum seeking 
vector field on SE{3) is given by the following vector field 

6 ^33 
- Oi sin(a;jf) exp o^ sm{uJit) — ,-)gj — , 

i=i i=i eg, 

(46) 

where exp is the exponential operator defined on SE{3). In 
this case, the exp operator is not the same as the exp operator 

/ S V 

on SO(3). For a tangent vector 


0 a b 

where S = ( —a 0 c 
—b — c 0 


0lx3 0 

we have exp( 


S V 

0lx3 0 


e se(3), 
) = 


exp(S') Av 

0lx3 1 


where A = / 3 X 3 + 


(1—cos(0)) 
02 


S + 


(9 sin(e)) g 2 ^ g _ -y/o^ + &^ + . In the case that 0 = 0, 


we have exp( 


S V 

0lx3 0 


) = 


exp (S') V 

0lx3 1 


The extremum seeking for synchronization of the agents in 
this example is given by 

6 6 g 

9j = -Yj. sin(a;if) x j(^gi- exp(^ o- sin(a;,H)—), 


2=1 

6 


2=1 


93 • 


92 ■ exp(y o^ sin(a;2f)—), 

ti ^9r 

3 ^ \ ^ 

exp(y|afsin(w(*f)—,j = 1,2,3. (47) 


9i 


,92 


1 


The initial configuration of agents are given by 
/ -0.3766 - 0.8917 0.2509 5 \ 

0.7877 -0.1658 0.5934 

-0.4875 0.4211 0.7648 

Vo 0 0 

f -0.5165 - 0.8489 0.1122 4 ^ 

0.7420 - 0.3784 0.5534 2 

-0.4273 0.3691 0.8253 1 

0 0 0 1 

-0.2961 - 0.9038 0.3089 5 

0.8213 - 0.0759 0.5654 2 

-0.4875 0.4211 0.7648 0 

VO 0 0 1 


93 


Figure 


/ .. 


shows 


the convergence of the synchronization algonthm in 
terms of minimizing (42i for a proper set of frequencies 
ujjo = l,2,3,i = I,-- - ,6. Figures fiflO show the 

synchronization of 51 , 52,53 on SE^{3). 



Fig. 6. Convergence of the synchronization cost on SE(3) 



Time 


Fig. 7. Convergence of the first columns of gi^ 92 i 92 , 
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